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ABSTRACT 

A large-scale test development project at the 
Language Teaching Research Center of the University of Gothenburg 
aims to develop tests in English as a foreign language for use in 
various areas of business and public administration. After testing, 
certificates stating current proficiency level in each of the four 
language skills (listening, reading, writing and speaking) will be 
given. Each person's knowledge of the language will be rated on a 
five- point scale. The project work involves correlation studies of 
the interrelationship between different parts of the test and betVfeen 
language proficiency ami various intelligence factors. In one 
investigation an English language placement test was administered 
parallel to a battery of psychological tests covering analogies, 
opposites, verbal fluency, spatial ability and Pukort, a Swedish 
version of the Purdue Creativity Test. Personality tests measuring 
dominance, deliberateness, sociability, emotionality, flexibility, 
perseverance, emotional stability and independence were administered. 
Results show that certain relationships ezist between language 
proficiency measures and personality and psj^cho logical variables. . 
This should be considered when assessing foreign language mastery. 
(CHK) 
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1. Introduction 

This paper presents briefly a large-scale test 
development project that is being carried out 
at the Laiiguage Teaching Research Center, Uni- 
versity of Gothenburg, Sweden. The aim of the 
project -['5 to develop tests in English as a 
foreign language for use in various areas of 
business and public administration. The project 
is sponsored by the Swedish Employers" Confede- 
ration ( SAF ) , Stockholm, and the Swedish Council 
for Personnel Administration ( PA-radet ) , Stock- 
holm. The tests are planned for use on a nation- 
wide basis in any situation where the foreign 
language ability of a person, or a group of 
persons, needs to be assessed. Certificates 
stating current proficiency level in each of 
the four language skills (Listening, Reading, 
Writing and Speaking) will be given. 

The first two years of the project are being 
devoted to the preparation of standardized 
proficiency tests in Englis., covering the 
following areas: Vocabulary, Grammar, Reading 
Comprehension, Listening Comprehension, Writing 



ERIC Speaking Ability. 
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2. Organization of Tests 

Before taking the main test the candidate is 
given a short introductory test measuring word 
knowledge and general language ability. The re- 
sult on this test determines which level of the 
main test should be taken. The main test con- 
tains sub-tests measuring each of the four 
language skills. 

The organization of the tests is shown in Fi - 
gure 1 : 



Main Test* Level II 




Figure 1 
The Organization of the Tests 

The short introductory test is administered main- 
ly for reasons of economy. Having a rough estimate 
of the candidate's general proficiency in the 
language enables one to assess quite reliably 



the more exact level in a relatively short time, 
and it saves the candidate from being subjected 
to questions that are too easy or too difficult 
for him. 

The placement test takes about 20 minutes and 
the main test 2 1/2 - 3 hours to administer. 



3. Evaluation of Test Results 

Each candidate's knowledge of the language will 
be expressed in "operational" terms. For this 
purpose a 5-point descriptive, absolute scale 
has been worked out for each of the four skills. 
Test scores will be converted into scale levels, 
which state explicitly the candidate's actual 
control of the language. On the basis of the 
test results a person may thus, for instance, 
be placed at the following proficiency level 
with regard to listening comprehension; 



"Understands normally everything 
that is being said at normal speed 
in standard language. Can have cer- 
tain difficulties in comprehending 
unfamiliar dialect, as well as tele- 
phone and radio messages received 
under poor listening conditions." 



Obviously, this aspect of the evaluation is both 
ERylC crucial and difficult, especially as it is mainly 



based on the performance on multiple-choice tests, 
and it links up with validation problems. We have 
not yet reached the stage where we can finally 
test the feasibility of our idea. 

4. Research 

The project work involves correlation studies 
of the interrelationship between the different 
parts of the tests, as well as studies of the 
correlation between language proficiency and 
various intelligence factors such as general 
verbal comprehension, ability to draw logical 
conclusions and ability to perceive spatial 
relations. The language test results are further- 
more being correlated with a number of persona- 
lity traits as measured by a new personality in- 
ventory called EPF, which covers eight diffe- 
rent traits. Each trait is measured by means of 
ten self-assessment questions (Ekvall, 1975). 
Finally the language test results are being 
correlated with performance on tests aimed at 
revealing so-called divergent production, which 
is thought to be a factor underlying creative 
ability. 



4.1 Findings 

I am now going to present some of the data ob- 
tained on the relationship between English 
language proficiency, as measured by our new 
tests, and various psychological and other 
variables. ''^ 



am greatly indebted to Dr Rune Holmquist, MalmS, 
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In one investigation one of our short placement 
tests was administered parallel with a battery 
of psychological tests to 53 farm management 
students. The English test consisted of 40 voca- 
bulary items and 20 sentence-combination items . 
(so-called rejoinders). The Kuder-Richardson 
reliability index (formula 20) for the whole 
test was ,91. 



EKLC 



The psychological test battery consisted of the 
following sub-tests (the descriptions have been 
formulated by the author on the basis of the ori- 
ginal Swedish presentations) : 



1. WIT III : Analogies 



2. WIT III : Opposites 



3 . Wl : Verbal fluency 



4. WIT III : Spatial 
ability 



5. Pukort 



Part of a general intelligence 
test. Measures ability to draw 
logical conclusions on the basis 
of verbal material (mother-tongue 
vocabulary items) . 

Measures general verbal comprehen- 
sion in the native language as 
shown in the ability to select 
the appropriate opposites of 
lexical items presented. 

A short verbal fluency test to be 
taken within a time limit (4 minutes), 
The subject is asked to write as many 
words as he can of a specified type. 

Also a sub-test in the intelligence 
test (WIT III). Measures ability 
to perceive two-dimensional spatial 
relations ("jig-saw puzzle" tasks). 

A Swedish version of the Purdue 
Creativity Test. Measures what is 
called divergent production, which 
is an essential and necessary com- 
ponent in creative thinking. 



The following eight sub-tests are all included in EPF, a 
Swedish personality inventory measuring eight different 



variables . 



6. EPF: Dominance 



Measures a person^'s striving for 
leadership and responsibility, and 
his wish to influence and dominate 
other people. 



9. EPF: Emotionality 



7. EPF : Deliberateness Refers to the degree of spontaneity 

and impulsiveness in a person's 
reactions. A high value on this 
variable indicates a person who 
wishes to plan and work in a care- 
ful and deliberate manner. 

8. EPF: Sociability This measure gives a person's 

position' on the extroversion--intro- 
version scale. A high degree o2 
sociability means facility in 
establishing relations with others 
and a liking for other people's 
company. 

Measures the degree to which a 
person is dominated by and gives 
vent to his emotions. A highly 
emotional person experiences 
feeling like sorrow, happiness, 
compassion and anger more often 
and more intensively than the 
ordinary person. 

Measures a person's attitude towards 
change, and his readiness and ability 
to adapt to new situations. 

This variable concerns the degree of 
perseverance and determination 
demonstrated by a person's behaviour. 

A high score on this variable is 
indicative of a personality with 
a generally optimistic and even 
temperament. A low score indicates 
a variable temperament, ranging 
from the highly optimistic to the 
very pessimistic, and poor ability 
to endure stressful situations. 

This trait shows a person's degree 
~ of independence with regard to other 

people's views, decisions, and acts. 
A low score indicates a person who 
is afraid of expressing deviating 
opinions and who tends to agree 
with the person he is talking to at 
the moment. 

Table 1 presents the correlations among all the variables 
(one asterisk denotes significance at the .05 level, two 



10. EDP: Flexibility 



11. EPF: Perseverance 



12. EPF : Emotional 
stability 



13. EPF: Independence 



asterisks significance at the .01 level): 



(jJ N3 l-» O 



00 









L*J 


frl 


frl 








W 


w 




5^ 












w 
















c 


M 


M 


M 






uw 








»sj ' 












H 


H 


H 
























o 
































M 


M 


•-4 










w 






W 








rr 


M 


M 








(D 




a 

S3 








o 


fD 


o 




M 


M 


M 






CO 




Q 




fD 


§ 




1— » 


§ 
















fl) 




CO 




ft 




H* 






























o* 






CO 


O 


> 


H 




< 


CD 




< 


o- 


o 




fD 


0) 






•o 




O 


(D 


O 




CO 


(D 








^< 








•o 


0) 


rt 




o 


o. 


rr 


1^ 




0) 




P) 


O 




rr 


o 






o 




(D 


0) 


0) 








rr 


(D 






CO 


0 










o* 




rr 




rr 


(D 






0) 


H« 


OP 






c 


O 


H« 


O 




rr 


*< 










rr 


H» 




o. 




(D 


h-» 


(D 








(D 










(D 


















CO 










CO 






H 




ft 










CO 
















»< 



























I-* N3 



CO 



I— O 



CO N3 

oj ^ 00 ro 

X 



ro o 
o o 



I— o 
Ui 00 



o 



o 



o o 



I 



o 



o 



o 



N3 



O 



O 



o 



o 

00 



o 



N3 



N5 
O 



OJ •£> O 

00 vO ^ O 

X X 

X X 



o o o 

^ 00 I-* 



o o 



o 

N3 



o 

ON 



I 



N5 



O 
O 



O 
O 



ro >— ' N3 o o 

h-» CO o 

X 



i-» UI ro 

Ui 
X 
X 



I 

W Ui I-' 

00 -vj 
X X 
X 



1 1 I 

to to O 
oj o ro o 

XXX 



00 U1 O 00 
X 



o w 

GO 00 
X 



o 



N3 
N3 



W I-' 
00 00 

X 

X 



J> o o 

OJ ^ o 

X 

X 

I t- 

*^ b 

N3 O 



O 
O 



X 



l-» lO »-» 
VO 00 



o 



o 

VO 



O 
00 



ro I-* 
o I- 



ro •£> 

X --^ 
X 



U? to O 

00 00 o 

X X 

X X 



U5 O 

o 

X 



o 



o 
o 



o 
o 



o 

VO 



to 00 



o 
o 



00 



o 
o 



o 
o 



to 



00 



VO 



lO 





H 




0) 




o* 




»-» 




(D 








• 


< 


M 








rt 




(D 




i-t 


a* 


O 




O 


(D 


i-( 


CO 


i-( 




(D 


H» 


l-» 




03 




pr 


03 






o 


CO 




03 


CO 


g 




•§ 


o* 




(D 


(D 


rt 




<: 


O 


(D 




(D 










03 


W 






§ 


OQ 




i-» 




H» 


03 


CO 






0} 




OQ 




(D 


03 


g 






OQ 


V3 


C 


rr 






OQ 


CO 


(D 


pr 




C 




Oi 




(D 


o 




Hi 


pr 




CO 


o 








(D 








O 


n 










(D 




CO 








l-» 




ft 




CO 




03 












< 




03 












o 




c 




CO 








CO 




*< 




o 




p- 




o 




l-» 




o 




OQ 




H» 




O 




03 








03 








o« 




►id 




(D 




»i 




CO 




o 








o 








o 




OQ 








o 




03 







: 8 



The English test has the highest positive correlation 

. with one of the verbal tests ( WIT III ; Opposites; 

r = .33), which measures comprehension o£ words in 
the "native language. An equally high coefficient, 
although negative (r = -.33), appears with the 
personality trait called Deliberateness . This would 
seem to indicate that the person who tends to 
ponder for too long over which option to pick in mul- 
tiple choice items is more likely to go wrong than 
the person who acts on impulse. If this finding 
is substantiated by other pieces of research it 
would probably be helpful to formulate test in- 
structions accordingly, i.e. to give some sort o£ 
advice to the candidates not to spend too much 
time on any particular item. 

The fact that proficiency in English correlates 
equally high with an intelligence variable and a 
personality variable might be taken as evidence 
that effective prediction of language mastery 
must take into account personality factors, ovet 
and above actual language test results. This has 
also been pointed out by many writers. Commenting 
on the topic Clark (1972) states that "the student's 
linguistic proficiency in a foreign language--a3 
evidenced by accuracy of pronunciation, range of 
vocabulary, level of grammatical control, and so 
forth--;;. only a tenuous and not easily estab- 
lished relationship to his communicative prof iciency, 
O defined as his ability to "get a message across" 

ERJC' 

. : with a specif ied ease and ,^ociAl.,effect^^ 



A few calculations have also been made of the 
correlation between reading comprehension skills 
and the lactors presented above. A reading test 
consisting of short pieces of text followed by 
comprehension questions of the multiple choice 
type was admi.iistered to a group of vocational 
guidance counsellors. The texts were intentionally 
kept quite short in order to make the test as 
"direct" and as little dependent on memory factors 
as possible. 

The psychological test battery included an inductive 
logical test, which was intended to show to what 
extent performance on a reading test covaries 
with inductive-logical ability. 

The results are reported in Table 2: 

Table 2 

The Correlations between Reading Comprehension 
Skills arid Various Psychological and Personality 
Variables in a Sample of Vocational Guidance 
Counsellors (N = 20) . 



Reading Test 


1. 


Inductive-Logical Test 




2. 


WIT III: Spatial Ability 


.36 


3. 


Shapes: Spatial Ability 


.40 


4. 


WIT III: Opposites 


.33 


5. 


Wl: Verbal Fluency 


.18 


6. 


EPF: Dominance 


-.26 


7. 


Deliberateness 




8. 


Sociability 


.42^* 


9. 


Emotionality 




10. 


Flexibility 


.36 


11. 


Perseverance 


-.31 


12. 


Emotional Stability 


-.08 



It is to be noted that the sample is very small (N = 
and therefore the coefficients can merely be regarded 
as indications of the kinds of relationships that 
might exist. 

However, in this sample the Reading Test has the 
highest positive correlation with the inductive- 
logical test (r = .67; p<.01). It thus seems as if 
success on reading comprehension test consisting of 
texts followed by multiple-choice questions is to 
some, if not a large, extent dependent on inductive 
and logical reasoning abilities. The coefficients for 
the other psychological variables are non-significant 

The personality traits measured by the EPF inventory 
correlate positively with reading comprehension in 
two sub-tests, namely Sociability and Emotionality 
(p^05). It is further of interest to note that we 
again tend to get a negative relationship between 
results on a language test (Reading) and the personc- 
logical variable called Deliberateness , which would 
seem to mean that a certain degree of spontaneity 
and impulsivenss is advantageous to the attainment 
of good language scores. 

It has been suggested that the ability to learn 
foreign languages might be inversely related to 
spatial ability. In a study with American freshmen 
Stafford (1972) found negative relationships be- 
tween grades in foreign language courses and 
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spatial visualization aptitude as measured with the 
Identical Blocks Test. Our findings do not support 
those results* If anything there is a tendency 
towards a positive connection between foreign 
language achievement and spatial ability in our 
samples • 

Summing up the results of the correlation studies 
with tests of English as a foreign language, we 
may say that there appears to eaist certain 
relationships between language proficiency 
measures on the one hand and personality and psycho- 
logical variables on the other, which ought to be 
taken into account when one wants to make pre- 
cise assessments of anyone^s foreign language 
mastery. 
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